An Empirical Validation of Oracle Improvement

We propose a human-in-the-loop approach for oracle improvement and analyse whether the proposed process is helping developers to create better oracles. For this, we conducted two human studies with 68 participants overall: an assessment study study. Our results show that exhibit poor performance (29 percent accuracy) when manually assessing assertion contains false positive, negative or none of two. This shows automated detection these deficiencies beneficial users. tool OASIs (Oracle ASsessment Improvement) helps produce assertions higher quality. Participants who used in were able achieve 33 full 67 partial correctness as opposed without achieved only 21 43 correctness.